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1 .       Introduction 

A  problem  which  has  developed  into  one  of  considerable  importance 
and  interest  is  that  of  accounting  for  the  improvement  or  upgrading  of 
reliability  through  corrective  action  on  an  item  or   system.      This  problem 
arises  in  the  development  stage  when  failures  are  relatively  frequent  and 
various  failure  modes,    observed  through  design  inspection  or  testing, 
can  be  removed.      Whether  corrective  action  takes  place  through  design 
changes  or  development  modifications,    it  is  common  to  assume  that  the 
action  never  decreases  reliability  and,    at  least  occasionally,    actually 
increases  reliability,    hence  the  term  reliability  growth.      Generally 
speaking,    the  mathematical  models  developed  for  this  problem  concern 
two  objectives:     (1)   the  prediction,    before  testing  is  initiated,    of  the 
reliability  that  should  be  attained  at  various  stages  of  development;    and 
(2)    the  estimation  of  reliability  as  a  function  of  one  or  more  parameters 
from  test  data.      In  general,   the  latter  objective  is  attained  by  making 
statistical  inferences  from  observed  test  data,    while  the  former  is 
gained  through  the  use  of  probabilistic  models  using  certain  assumptions 
concerning  the  failure  modes  and  the  repair  policy. 

This  paper  concerns  the  exposition,    in  a  uniform  setting,    of  several 
prediction  models  appearing  in  the  literature  and  incorporation  of  some 
general  features  into  them,      We  therefore  begin  with  a  brief  review  of 
these  models. 


Lloyd  and  Lipow   [2]    consider  a  system  assumed  to  contain  a 
single  failure  mode.      A  testing  program  is  carried  out  for  the  purpose 
of  discovering  and  removing  the  failure  mode.      On  each  trial,    the 
system  fails  with    (known)    probability   q    (i.  e.  ,    the  system  has  reli- 
ability    1    -  q  )    if  the  failure  mode  has  not  been  corrected;     otherwise, 
it  has  reliability    1  .      On  each  trial  resulting  in  a  failure,    an  attempt 
is  made  to  permanently  repair  the  failure  mode.      It  is  assumed  that 
on  each  such  attempt  the  probability    0     of  succeeding  is  known. 

Thus,    in  the  model  of  Lloyd  and  Lipow,    the  system  is  either  in  an 
unrepaired  state  or  a  repaired  state  after    n   tests  have  been  performed, 
Using  a  difference  equation  for  the  probability  that  the  device  is  in  the 
unrepaired  state  after    n   tests,    Lloyd  and  Lipow  show  that  the  reliability 
of  the  system  for  the     n  +   1  st    test  is      1    -  q  ( 1    -  q0  ) 

Pollock   [3]    considers  a  similar  system,    in  which  the  repair 
probability    0     is  known,    but  the  failure  rate     q       of  the    "repaired" 
system  is  not  necessarily  zero    (nor  even  less  than   q)  .      Under  various 
assumptions  concerning  the  distribution  of  failure  occurrences    (such  as 
Poisson  or  Bernoulli)    and  whether     q    and    q       are  known  or  have  some 
known  prior  distribution,    Pollock  obtains  the  failure  rate  distributions 
at  time     t    (in  the  continuous  case)    and  the  density  of  the  failure  proba- 
bility at  the     n  +   1  st   trial   (in  the  discrete  case)  . 

Weiss    [5]    considers  a  system  possibly  containing  several  failure 
modes,    each  with  the   same  exponential  failure  distribution.      It  is  assumed 


-   2   - 


that  the  failure  modes  present  in  the  system  are  drawn  from  a  popula- 
tion of  potential  failure  modes.      This  allows   some  relief  from  the 
rather  strict  assumption  that  all  failure  modes  have  identically  the 
same  failure  rate,    in  that  a  higher  failure  rate  for  a  mode  can  be  mod- 
eled roughly  by  a  higher  probability  of  the  presence  of  that  mode  in  the 
system.      The  mean  time  to  failure  of  the  system  is  increased  through 
removal  of  observed  failure  modes. 

Finally,    Wolman   [6]    considers  a  system  in  which  failures  are  of 
two  types,    which  we  shall  call    "inherent"    and    "assignable  cause"    fol- 
lowing the  terminology  of  Barlow  and  Scheuer    [  1]  .     Each  trial  may 
result  in  exactly  one  of  the  following:     success,    inherent  failure,    or 
assignable  cause  failure.      It  is  assumed  that  the  system  originally 
contains    k   assignable  cause  failure  modes,    and  once  failure  of  such  a 
mode  is  observed  the  mode  is  permanently  repaired.      On  each  trial, 
the  remaining  assignable  cause  failure  modes  each  occur  with  known 
probability   q.      Under  certain    "independence"   assumptions,    Wolman 
shows  how  a  Markov  chain  model  can  be  used  to  obtain  the  reliability 
of  the  system  after    n  trials  have  been  made. 

The  consideration  of  several  assignable  cause  modes  in  the  system 
makes  it  important  to  distinguish  carefully  between  the  observation  of  a 
failure  and  the  repair  of  a  mode.      This  is  of  importance,    for  example, 
in  consistently  modeling    independence    of  failure  modes.      It  is  also  of 
interest  to  consider  various    "repair  policies"    and  their  effect  upon 
system  reliability  after    n   trials. 
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In  what  follows,    we  consider  models  encompassing  the  various 
features  mentioned  above.      Since  the  computational  difficulty  in  a 
particular  application  may  be  substantial,    some  effort  is  directed 
toward  establishing  several  methods  that  can  be  used  for  finding  the 
(predicted)    reliability  of  the  system  after    n   trials.      It  should  be  kept 
in  mind  that,    throughout  the  paper,    the  problem  being  considered  is 
that  of  predicting,    before  testing  is  undertaken,    what  the  reliability 
of  the  system  will  be  after    n   trials  or,    from  another  point  of  view, 
predicting  the  number  of  trials  required  to  attain  a  given  reliability. 
Because  of  its   simplicity,    we  begin  with  a  discussion  of  a  system  with 
a  single  assignable  cause  mode,    Lloyd  and  Lipow's  model  being  a 
particular  example    (model  I)  .      We  then  extend  to  a  system  with   k 
assignable  cause  modes,    assumed  to  be    "equally  likely"     (model  II)  . 
Finally,    a  system  with   k   non-equally  likely  modes  is  considered 
(model  III)  . 

The  following  notation  conventions  were  found  to  be  useful. 

(a)  Empty  sums     (that  is,    summations  in  which  the  upper  limit 
on  the  index  is   smaller  than  the  lower  limit)     are  taken  to  be  zero. 

(b)  Empty  products  are  taken  to  be  one. 

(c)  In  some  conditional  probability  statements  involving  the  out- 
come of  a  test,    given  a  condition  just  prior  to  the  test,    no  specific 
mention  of  this    "timing"    is  made.      Thus,    for  example,     P  (E  j  E) 
might;  denote  the  conditional  probability  that  the  system  is  in  state  E 
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immediately  after  a  trial,    given  that  it  is  in  state  E  just  prior  to  the 
trial.      The  context  should  make  the  meaning  of  such  symbols  clear. 


2.       Model  I:     A  Single  Assignable  Cause  Mode 

Suppose  the  system  under  consideration  contains  two    "failure 
modes",    one  associated  with  inherent  failures  and  the  other  associated 
with  assignable  cause  failures.     (The    "inherent  failure  mode"    is  im- 
agined to  exist  for  ease  of  exposition.      In  particular,    it  may  be  taken 
to  be  that  part  of  the  system  other  than  the  assignable  cause  failure 
mode.  )    Assume  that  on  each  trial  the  probability  of  an  inherent 
failure  is    q     ,    and  if  the  system  is  unrepaired  and  an  inherent  failure 
does  not  occur,   the  probability  of  an  assignable  cause  failure  is    q  ; 

otherwise,    the  probability  of  an  assignable  cause  failure  is  zero.      If 

fVi 
we  let     I       denote  the  event    "an  inherent  failure  on  the    n       trial", 
n 

A      denote  the  event    "an  assignable  cause  failure  on  the    n    L  trial", 
n  5 

th 
and  if  we  say  that  the  system  is  in  state    0    for  the    n       trial  if  it  is 

unrepaired  after    n  -   1    trials    (denoted  by    "  E.  ,    ,!)  ,    while  if  re- 

r  •  0,11-1 

paired  after    n  -  1    trials  the  system  is  in  state    1    for  the   n       trial 
(denoted  by    "E  "),    the  above  assumptions  can  be  stated  for- 

mally as  follows: 

for     n   =    1  ,    2  ,    3  ,    ...    , 


P[I,flA    ]    =P[I|E  ] 

un  n  n  '       1  ,    n  -  1   - 


P  [  l     I   En  i    ]     =     % 

u    n  '       0  ,    n  -  1   "  0 


[  I     PI    A     ]     =    P  [A    I  E.  .   ]     =    0 

Ln  nJ  ln!       1  ,   n  -  1  J 


P  [  A    I  I     PI    E0  ,    ]     =    q 

L      n  !    n  0  ,    n  -  1   d 
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It  follows  that  the  conditional  probability  of  an  assignable  cause  failure 
on  the    n       trial,    given  the  system  is  in  state    0  ,    is 


L      n  I       0  ,    n  -  1   J  v  M0     M 

Before  considering  a  more  general  repair  policy,    we  digress   some- 
what to  consider  the  relatively  simple  repair  policy  of  Lloyd  and  Lipow; 
namely,    the  system  is  repaired  at   (i.  e.  ,    immediately  after)   the    n' 

trial  with  probability  0    if  an  assignable  cause  failure  occurs  at  the 

■f-u 
n       trial;    otherwise,    it  is  repaired  with  probability  zero  .      (This 

corresponds  to  the  repair  policy  in  which  an  attempt  is  made  to  re- 
pair the  assignable  cause  failure  mode  each  time  it  is  observed  to 
fail,   these  attempts  being    "identical".  ) 

Since  the  reliability  of  the  system  after    n  trials,    R     ,     is  given 
in  this  case  by 

1 

R=EP[I.nALl|E.  ]     •    P  (E.         ) 

n  .    .  Ln+1  n+  1    !       i,nJ  i,n 

=    p  [T      _   n   A       .   |En        ]     •    P  (E.        ) 
Ln+1  n+  1    '      0,nJ  v     0  ,    n' 

+    (1-P[I    Ll    U    A    ,,|E.  ])     *     P  (E  ) 

L   n+  1  n+  1  •       1  ,    n  J  0  ,  n 


=     d-q0)    d-q)     P(EQ>n)    +     (1    -qQ)    (1    -F^n11 


(1   -  qQ)   (1  -  q     P  (E0>  n)  )  (1) 
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it  is  of  interest  to  determine    P  (E  )     for     n    =    1  ,    2  ,    .  .  .      .      Lloyd 

and  Lipow  solve  essentially  the  same  problem  by  considering  a  differ- 
ence equation  for     P  (E  )  .     An  alternative  is  as  follows.      The  one- 

0  ,  n 

step  transition  probability  matrix    (p..       )     for  this  process  is  easily 
seen  to  be 


o  ■ 


fqoMl-qo)[(l-q)   +    q(l-0)]      (1  -qQ)q0 


where 


p.(1)     -    P  [  E.  IE.  ] 

ij  J  ,    n+  1  l       l,    n 


that  is,    p..         is  the  probability  that  the  system  goes  from  state    i    to 
state    j    in  one  trial.      The    n-step  transition  probability  matrix 


<pi?V<,> 


n 


is  thus  given  by 


(Pij      )    - 


(1    -    g0)n  1    -   (1    -    g0)n 


where 


g    =    ( 1  -  q0  )  q 
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This  is  easily  established  by  observing  that  each  main  diagonal  ele- 
ment in  the  product  of  the  two  upper  triangular  matrices  is  the  product 
of  the  corresponding  main  diagonal  elements  from  these  matrices  and 
that  a  product  of  stochastic  matrices  is  stochastic.      If  the  process 
starts  in  state    0   with  probability    (3       and  if 


p  =  '.v  1  -  V 


then 


P  (P,(n)  )    =    (P(E.  )  ,     1  -  P(E 

ij  0  ,    n  0  ,  n 


so 


PfE0,   n»     =    V   -80>n 


Substituting  this  in   (1)    yields  the  predicted  reliability  of  the  system 
after    n  trials, 


R       =    (1   -  q    )    (1   -  q   0     (1    -  g0)n)  (2) 

n  U  (J 


Note  that  this  reliability  is  conveniently  expressed  in  a  matrix  product 
form  by 


( ]    -  q    )    (1    -  q) 

R     =   Mp°'|  ° 

d-q0) 
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The  special  case 


l0 


1    -    P0    =    0 


results  in  the  expression  for    R      derived  by  Lloyd  and  Lipow. 

A  more  general  repair  policy  that  might  be  of  interest  in  the 
present  model  is  as  follows.      Suppose  the  probability  that  the  assign 
able  cause  failure  mode  is  repaired  at  its    u^"   failure  is    bu    ; 


u   =    1  ,    2  ,    . 


Then 


P  (En        )    =    P  [A       &    (no  repair)  I    E^  ,   ]     ■     P  (Ert 

0  ,  n  Ln  l  *        ' '       0  ,    n  -  1   J  v0, 


n-  1 


+    P  [  A     I  E,  ,    ]     •     P  (Ert 

L      n  I      0  ,    n  -  i   J  0  ,    n  -  1 


n 


0  ,  n-  1 


,th 


£    [  u       assignable  cause  failure 
u=l 


at   nth  trial  I  Eft  ,   ] 

!      0  ,    n  -  1. 


•     (1    -   bu)    +    (1    -    g)  j 


Now 


th 


P  r  u       assignable  cause  failure  at   n       trial  I  E^  .    "1 

L  6  i      0  ,    n  -  1  J 


=     P  [  u  -   1    assignable  cause  failures  in   n  -  1  trial; 


&       A        I     EA  1    ] 

n  '      0  .    n  -  1 


n-l\         u  -  1    .  .  n  -  u 

(1   -  g)  •     g 


■a:i) 
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Let 


(^;)gu(i-g)n-u(i-bu) ; ».  i,  2, 


n 

n  -   1   -\      u 

s        =      L, 

n  i 

u=l 


Then 


P(E0,n>     "     P<E0,n-l»    [=n    +     ( '    "  «>  3 

where     P  (E  )     =     p  the  probability  the  system  starts  in  state    C  . 

It  follows  that 

n 
P  (E  )     =     R        n      (s.    +     (1    -  g)  )   ;     n    =    0,1,2,... 

0 ,  n  °    j=l         J 

Thus,    by   (1)  , 

n 
R      =    (1   -  q    )  (1   -  q  P         n     (s     +    (1   -  (1   -  q    )q)  )    ;     n  -  0,  1,2,,  ..      (4) 

j=l       J 


As  an  example,    note  that  in  the  case  where    b      =   0   ,    (4)    reduces 

u 

to  the  expression  given  in   (2)  ,    as  should  be  the  case.      Suppose,    for 

th 
another  example,    that  a  repair  attempt  is  made  only  after  the   j 

assignable  cause  failure,    with  probability   b    of  a  successful  repair. 

Then    R      is  given  by   (4)  ,    where   b     =0    for    u  /  j    ,    b.  -  b  .      In  this 
n         °  u  j 

case,       s      =  g   for    n<  j    and    s      =  g(l  -b  ^     .  jgw  (l-g)J 

for    n  >  j  .      Then      P  (Ert  )     =     pn     for    n<  j  , 

J  0  ,  n  0  J 


11 


k"l\    jn  _x  k    "   J     - 


p<Eo.n»  =  ^o  kn.  [i-bCj:i)gJ(1-g)     J 


for     n    ^    j  .      Thus,    for  example,    when    n    ^    j  , 


Rn  ■  d-q0)(i-qe0     n    [i-b(jk:;)gj(i-g)k-J]t 

k-J 
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3.       Model  II:    k   Equally  Likely  Assignable  Cause  Modes 

We  now  consider  the  basic  model  of  Wolman  [6]    in  a  setting 
similar  to  that  of  Model  I  in  the  preceding  section,    together  with 
some  alternatives  and  generalizations  concerning  repair  policies, 
initial  states  of  the  system,    and  methods  of  computing    R     .      It  is 
hoped  that  the  present  approach  clarifies  the  role  of  Wolman's 
"independence"    assumptions  and  corrects  several  typographical 
errors  in  a  discussion  of  Wolman's  paper  by  George  Weiss    [4]  . 

Suppose  the  system  under  consideration  is  composed  of   k 
assignable  cause  failure  modes    (hereafter  called    "type  II"  modes] 
and  an  inherent  failure  mode    (called  a    "type  I"  mode),    with  a 
series  hookup  as  depicted  in  Figure  1  . 


failure 
probability 


k   type  II  modes 


FIGURE  I 
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Suppose     "I   "    denotes,    as  before,    the  event  that  an  inherent 

n 

failure  occurs  on  the    n**1   trial,    while    "A    "    denotes  the  event  that 

n 

at  least  one  assignable  cause  failure  occurs  on  the   n*"-n  trial.      We 
make  the  following  assumptions:     on  a  given  trial   (i.  e.  ,    for  any   n  , 
n    =     1  ,    2  ,    ...    )  , 

1 .  P[I    ]     =    P[I     0    A    ]     =    qn 

n  n  n  0 

(the  inherent  failure  probability  is  constant), 

2.  If  the   j  th  type  LI  mode  is  unrepaired  prior  to  the   nt"   trial, 

P  [j"h   II  fails  I  I     ]     =    0  , 
1     n 

P  [  j th    II   fails  |   I    ]     =    q    =     1     -    p 

(assignable  cause  failures  in  unrepaired  type  II  modes  are 
equally  likely  and  may  occur  only  if  an  inherent  failure  does 
not  occur). 

3.  The  type  II  modes  are  independent  in  the  sense  that  given 
that  there  are  several  type  II  modes  which  are  unrepaired 
prior  to  a  trial  and  given  that  an  inherent  failure  does  not 
occur  on  the  trial,    the  probability  that  these  type  II  modes 
all  fail  on  the  trial  is  the  product  of  the  corresponding 
probabilities    q  . 

We  say  that  the  system  is  in  state    i(i=    C,    1  ,    ...,k)    for  the 

n*"   trial  if    i  type  II  modes  have  been   (permanently)    repaired  after 

n  -   1    trials.      Let    "E  ]   denote  the  event  that  the  system  is  in 

i ,    n  -   1 
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state    i,    assumption   (3)    above  implies  that  on  the   n"1   trial 

k  -  i 


p[ a     e  n  i  3  =  P 

n  '       1  ,    n  -   1  n  J 


Let  us  first  consider  the  repair  policy  which  leads  to  Wolman's 
model. 

If,    on  a  given  trial,    at  least  one  type  II  mode  fails,    exactly 
one  type  II  mode  is  repaired. 

Under  this  repair  policy,    it  is  relatively  straightforward  to 
compute    R      by  any  one  of  several  approaches.      These  approaches 
have  in  common  a  consideration  of  the  transition  probabilities  of 
the  system.      The    k  +   1  x  k  +   1    matrix  of  one-step  transition  proba- 
bilities has  a  simple  form  in  the  present  case.      In  fact,    on  any  trial, 
for     i  =  0,l,2,...,k, 


p.(1)    -    P  [E.         IE.  .   ]     =    P  [  A    I  E.  ] 

*ii  L     l ,  n  '       l ,    n  -   1  J  L      n1       l  ,    n  -   1  J 


=    P  [  A         E.              ,    n     I     ]  •     P  [  I     3 

Ln!       l ,    n  -  1            n  w  unJ 

+    p  r  a    I  e.           ,  n    I    ]    •    P  [  I    1 

Ln'i,n-1  nJ               unJ 


Pk  "  "  (i  -  qj   +   qn  (5) 


p.  ,(1)    -    P  [E.  IE.  .   3     =    P  [  A    I  E.  ] 

*i  t    x  +  1  L     x  +  1  ,   n '      x,    n  -  1  J  Ln'      i,n-lJ 


-     1    -Pii(1)      =     (1    -  qQ)    (1    "Pk   "   ')  (61 
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Thus, 


(Pij      ) 


q0+d-q0)pk     d-q0)(i-pk) 


q0+(i-q0)p        (i-q0)(i-P      ) 


. .  o 


V(1'qo)pk~    (1-q0)(1"pk_2) 


. 


If    6    =    (  P^  ,    3n    ,    B_   ,    .  .  .  i    3,   )     is  the  distribution  of  initial  states  of 
0         1  Z  k 

the  system,    that  is,    if 


3.     =     P  [  system  starts  in  state    i]  ;     i    =     0  ,    1  ;    , „  .   ,    k 

/  _  \  

then    3  (p..       )     is  the  distribution  of  states  occupied  by  the  system 

after    n  trials.      The  matrix  form    (3)    of  the  reliability  given  in   (1)    is 

easily  extended  to  the  present  case,    so  that  the  reliability  after    n 

trials  is  given  by 


R     =    B  <pjn)  ) 

n  XJ 


P 

k 


(1    -qQ) 


(7) 
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The  determination  of    (p..        )     is  not  as  simple  in  the  present 

case  as  it  was  for  Model  I.      Wolman  considers  an  approach  based  upon 

(1) 

a    "spectral  decomposition"    of    (p,.    '  )  ,    as  follows:    the  characteristic 

roots  of  the  positive  definite  matrix    (p..       )    are  simply  its  diagonal 


elements, 


k  -  i 
Xi    =    qQ    +    (1  -  qQ)  p  ;i=0,l,...,k 


Thus,    if  X    is  a    k  +   1  X  k .+    1    matrix  whose  rows  are  linearly  inde- 
pendent characteristic  vectors  of  P   and    A    is  the  diagonal  matrix  of 
corresponding    A..'s,    then 

(p..(n)  )     =     X~  *     An   X    ;    n   =    1  ,    2,    .  .  . 

Thus,    once    X  and  X  have  been  determined  (possibly  more  than  a 

routine  task),    (p..       )     is  easily  computed  for  all   n    since 


n 


n 


o 


An  alternate  approach  to  the  determination  of    (p..       )    has  been 
suggested  by  Weiss   [  4]  ,      In  this  approach,    the  elements  in  each  row 
of    (p.         )    are  computed  through  the  use  of  certain  generating  functions, 
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We  illustrate  this  method  for  the  ow  of    ifp  ':  . 


Gn.(e)    -     £    sn  p  ;  '   ;    se(0(l),i  =  0,l k 

01  n=0  Ci 


(ti)  1 1 )     n 

Note  that,    since    p^    '    = (p^    ') 


Goo(s)  =  =  sDpoon)  ;i  =  {si^  +  n-%)Pk:)n 

n=0  n=:0 


I 


,  (1) 

*  00 


Also, 

(n)  (n  -   1)  (1)  (n-1)        (1)  _ 

P0i         "    P0,i-1    '    Pi-1,  i  +   P0:l  Pxi  l,2,...,k  (8) 

Thus, 

n      ,    ,  "        n   r     (n  -  1)  (1)  (n-1)        (1)   -| 

G-.(s)    -      L     s  p        .  p.  .   +  p  p.. 

n=0 


(1)  ~        n  (V<  "       n        (n) 

=Pi~ l,i      S       *       S      PC,i-l    +    '  *       *     *      PC: 

n=0  n=0 


(1)  H) 

p.    ;    ' .      s   G_     .    .  (s)  t    p.}    ?    s   G_.  -  1,  2,  ....  k 

i-l,i  0,1-1  Oi 


Then 


G-.(-)    r1    -P»,1)-l    =     Pi     'V'         -    Gn      .      .(.] 

Oi  L  "  -i  %  -  I  ,  i  0,1-1 
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and 


Goi(s) 


(1) 
i-1  ,  i      0  ,  i- 


sp:    ■         Cn  ,(s) 


P: 


(1) 
i-1    , 


1 


-    p 


1) 


11 


1     -    p.. 
11 


(1 


9    Pi-zV:-!    G0,i-2<8> 

(1) 

1  -  p.  .        e 

l-l  ,  i-I 


S     P01       P12 


P: 


(1) 


i-1    ,    i 


(  1 )  fl)  (I) 

d-p/l      •)   d-P22'    •)    .-.    (l  -P, 


Goo(s) 


J 


:     1  -  0,   1  ,  ....  k       (9) 


n    -1  -p« 

i=0 


1' 


Using  partial  fractions,    the  second  factor  in   (9)    can  be  expressed  as 


•poo'V 


°0   (poo       -   Pjj 


j^o 


(p 


(1 


11 


(1) 


00 


n    (p 
i=o 


li 


i)  _      (i) 
pjj 


so  that 


1 


1-PU  » 


(pJ'V 


n    (p.;     -  p.: 

j=o  JJ 


J* 


l 


' 1 ' 

1    -  p. .         s 
n 
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Ln    s    po.       =  (  s      "    Pj-i    i ) 

n=0  j=l      J  J  ^ 


(      S       (P00      "a)         )     + 

m  =  0 


(P     (1)^ 

•pco 


n    (p 


(i)         (i) 


00 


-  p 


j; 


<>>' 


n  (p 


(1)  (l)v 

-   p..'    '  )      m-0 

11  JJ 


£      (p  .       s) 


By  comparing  coefficients  of  the  corresponding  powers  of   s    in  this 
expressions    we  find  that 


(n) 


Oi 


(1) 


i 
V       j=l  m=Q 


( 


(P 


(1)    V* 


mm 


(1)  (1)  , 

P  ~    P-- 

mm  jj 


n 


tf 


m 


for     n  <  i 


for     n  s  i 


The  other  rows  of    (p..       )     are  similarly  determined,    and    R       is 

ij  n 

computed  by   (7)  . 

An  alternate  approach  under  the  present  repair  policy  that  might 
be  of  some  interest  is  as  follows:  note  that  for  fixed  n  (n  -  0  ,  1  ,  2  , 
and    i   (i  =  0  9    1  ,    .  .  .  ,  k) 


p.  (n|.    ;   J  =  o,  i. 


,    k 
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is  a  mass  function,    since    (p.."     )    is  a  stocha  matrix.      Let 

J.         denote  the  random  variables  having  these  distributions.      Since 


n 


Rn     -     (1    -q0»MPlj     ') 


the  major  task  in  computing    R       is  to  find  the  elements  of  the  vector 


rv  (n)       k-j 

j=o 


(n)« 


Consider  the  first  component: 


Pr      ^  P 

j=0 
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k  k 

(n)      k-  j  k  (n)      /    1    \j 

*      poj       p  p       *     P0j         C  T  ) 


T(n> 


k     _  /*    ,    1    .       0        \ 

=  p     e((t,  ) 

P       *j(n)    (7   J 


where 


(n) 

I     ,,|t)    =    E|t  )   ;    t  «   ( 0 ,  1  ] 

J0 


(n) 


is  the  probability  generating  function  of  the  random  variable     J 

A  recursion  relation  for  the  generating  functions     ii     ,    ,    (t)     can 

(n)    v   ' 

Jo 

be  obtained  using  the  one-step  transition  probabilities  given  in   (5) 
and   (6)   together  with  equation  (8)  .      Thus, 
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k 


* 


1  r     (-m)  r  /,  v    k 


(-+«w  ■  » '['JrOo*  (1"qo,p     J 


Jo 


(m^       r  /i  v    /i  k-i+l      ]    1 

+    P0,i-1  [n  -q0)  (1  -P  >J  J 


k        .      ,    t  k 

r*      *}■      (n)  /i  x     k      «        /  t    \i       (m) 

%   .L0  4   Poi    +   <'-%>p      =     (t)    po> 


i-1         (m)      r  k-(i  -1)     -l 

+    t      St  p         _2   ^(1    -qQ)    (1    -p  )  J 


=  'o*j(-)(t)  +  (1  -qo,pk*J^(i) 


k 


+    {l-%)l   [♦(m)«t»    "    Pk+.«m»   (t)] 


0  0' 


Starting  from 

j(0) 
♦   (0)  (t)    =    E(t     °        )    =     1 

Jo 

one  can,    in  theory,    compute     ty         ,   (t)     for  successively  higher  values 

J0 
of    m  .      Unfortunately,    this  computation  becomes  tedious  for  large   m 

values. 

In  matrix  form,    the  vector  of  probability  generating  functions 

t    (n)  (t)     is  given  by 

l 
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(pjv 


*(n>(t) 

Jo 


T(n) 

Jk 


where 


1 


k 

_     t        J 


Since  a  convex  combination  of  probability  generating  functions  us  a 
probability  generating  function, 


3  (Pijn)  )  T    =    tn  (t) 


is  a  probability  generating  function.      (In  fact,     i|/       is  the  probability 
generating  function  of  the  random  variable  denoting  the  state  occupied 
after    n  trials.  )     It  then  follows  that 
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Rn    ■    (1    -%>Pk*n(T) 


Remark.      It  is  easy  to  incorporate  into  this  consideration  a  slightly- 
more  general  repair  policy,    as  follows. 

A  type  II  mode  is  repaired  with  probability  0    on  a  given  trial, 
given  at  least  one  such  mode  fails  on  that  trial. 

In  this  case,    we  replace  the  original  one-step  transition  probability 
matrix  by  one  in  which,    for     i    =    0,l,...,k;     n-1,2,... 


p..        =P[A     IE.  ,    ]     +    P[A      &    no  repair  I  E.  ,    ] 

11  L      n  '      1  ,  n  -  1  Ln  '      l ,  n  -  1  J 

=  q0  +  (i  -  Vpk~*  +  (1  '  V  (l  '  pk_1)  (1  "  0) 


(i) 

p         v    '      -     PA      &    a  repair  ] 
*i,  i+  1  L      n 


=     (1     -    qQ)  (1    -   Pk  "*)   0 


Of  the  three  approaches  to  computing    R      discussed  for  the  present 

repair  policy,    it  appears  that  none  is  clearly    "best"    under  all 

circumstances.      A  choice  of  which  to  use  would  probably  depend,    at 

least  in  part,    upon  factors   such  as  computer  availability,    size  of  the 

matrix    (p  )  ,    and  the  number  of   R    '  s   to  be  computed.      It  is  con- 

*1J  n 

ceivable  that,    in  some  circumstances,    the  approach  consisting  of 

(1) 

simply  multiplying    (p..      )    by  itself  the  required  number  of  times  is 

J 
worth  consideration. 
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Let  us  next  consider  the  following  repair  policy:    at  each  trial, 

all  type  II  modes  that  fail  are  repaired.      In  this  case,    the  matrix 

(1) 

(p..    '    )     has  elements  such  that 

(1) 
p      .       =    0  for      m    >     l  (10; 

mi 


Pi!11     -    PCAJEifn-lJ    =    q0   +    (1    "  V*"  I    i=0,l,,     .,k     (11) 


H)  M       „    ,  r'k'i\  .k"i-J   J  i         0,1,  k 

i,   i+j 


^vCV)^'1"^8  j1:?:^::::..!    ^ 


With  this     (p..       )    matrix,    one  could  compute    R      using  the  spectral 
ij  n  °  ^ 

decomposition  approach  discussed  above.      The  generating  function 
approaches   can  also  be  used,    although  the  computation  becomes  more 
involved.      This  is  because  simple  recurrence  relations  of  the  form    (8) 
under  the  former  repair  policy  must  now  be  replaced  with  relations  of 
the  form 

(n)  (n  -   1)      (1)  (n-1)  (1)  (n-1)      {1} 

P0i      "    P0i  PH       +     P0,i-1    Pi-l,i    +    •••     +    PC0  P0i 

Again,    the    "best"    method  to  use  to  calculate    R      would  probably  depend 
upon  the  particular  circumstances  involved. 

An  interesting  modification  of  the  repair  policy  in  which  all  type  II 
failures  at  each  stage  are  corrected  is  as  follows. 

At  each  stage,    each  observed  type  II  failure  is  corrected  with 
probability  0  ,    independent  of  other  failures  and  the  number  of  failures. 
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In  this  case,    elements  of    (p..      )    are  obtained  by  replacing   q 
with  0  q   in  (10)  ,    (11)  ,    and  (12)  .      This  rather  intuitively  obvious  state- 
ment may  be  more  rigorously  established  as  follows: 


p.*.1*     =     P  [  A     |  E.  .   ]     +    (1   -0) 

*ii  n  J      i  ,  n  -  1   J 


•     P  f  one  type  II  mode  failure  I  E.  1    + 

L  r  I      i,  n  -  1  d 


k-i 


+     (1    -  0  )  P  T  k-i  type  II  mode  failures     E. 

L  r  I       l , n-1   J 


v"-v[i-k-H(V) 


•   C  (i    -  0)  q  }J  ] 


q0  +  ( i  -  q0 )  [  p  +  ( i  -  0 )  q  ] 


=  q0  +   (i  -  q0)  [  i    -  0q]k  "  ' 


p.      .  =     P  T  one  type  II  mode  failure  &  one  repair  I  E,  ,]+'... 

*if  1+  1  L  y*  I       l  ,  n  -  1  J 

+    P  rk-i  type  II  mode  failures  &  one  repair  I  E.  1 

L  /c  '      l,  n- 1  " 


=  d-qo)0  e1  (k:i)pk"i"'i,lJ(i)(1-*)J"1       <13: 


noting  that 
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d#  'u  -»-v  |i^"1"J(K;l)j 


d  (U  /n  x         ^       k-i-j    /•   k  -  x 


{    (1   -0)q}J_1    (    -q) 


(1    -  qQ)   (k  -  i)    [p   +    (1    -0)q]k"1_1    (  -q) 


it  follows  that   (13)    is  equivalent  to 


Pi(/i+1   ^  (i  -  qo)0q(k  -  i)  [i  ^q]1""1"1 


Similarly,    it  follows  that 

i         k-i 
(1)  0  _  s  k  -  i  -v       k-i-mm 

Pi;i+j     (1-Vtt    s.   (   m  >  1 

m=j 
•    m  (m  -  1)    .  .  .     (m  -  j  +    1)   (1  -  0  )  J 


(1    ~  qQ)    -jj-     qJ    (k   -  i)    (k  -   i  -   1)     ...      (k  -   i  -  j  +   1 

•    [p   +   (i  -0)  q]  k  "  *  '  J 


j   /k-i\  k  -  i  -  j 


=     (1    -  qQ)    (0q)J(    :")     (1     "   0q) 


for      jl    =     0,    1  ,    ...  ,   k  ;    j    =     1,2,...,    k-i 
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4.       Model  III:  k  Assignable  Cause  Modes,    Not  Necessarily  Equally  Lik' 

Markov  chain  models  for  the  case  in  which  type  II  failures  are  not 
equally  likely  are  equivalent  to  models  in  which  type  II  failures  are 
equally  likely  but  the  repair  p'olicy  does  not  treat  the  failure  modes 
"uniformly".      In  what  follows,    we  shall  concentrate  mostly  upon  systems 
assumed  to  have  two  type  II  modes    (k    -    2)    in  series    (see  Figure  2)  . 


failure 
probability 


FIGURE  2 


One  aspect  of  Model  III  which  is  different  from  the  previous  models 
is  the  identification  of    "states"    of  the  system.      For  example,    suppose 
k   =    2  .      We  may  define  states  as  follows: 


State 

Condition 

0 

no  type  II  mode  repaired 

1 

mode    II      repaired 

2 

mode    II      repaired 

3 

both  type  II  modes  repaired 
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In  general,    with   k   type  II  modes,    there  are    2       states  of  this  nature. 

(1) 
Once  the  corresponding    (p..      )    matrix  has  been  obtained,    the  value  of 

J 

R      is  given  by 
n 

Rn    ''     (1   "  <10)  P  (Pi(n)  }    P  (14) 

where  the    j        component  of  the  vector    P    is  the  conditional  probability 
that  no  type  II  failures  occur,    given  the  system  is  in  state   j    and  a 
type  I  failure  does  not  occur. 

Let  us  assume  that  at  each  stage  all  type  II  failures  are  (permanently, 
repaired,    and  consider  two  example  models,    each  depending  upon  con- 
ditions imposed  on  the  occurrence  of  type  II  failures.      Extensions  to 
other  values  of  k   and  other  repair  policies  can  be  made  as  in  the 
models  considered  previously.      Consider  first  the  case  in  which  it  is 
assumed  that    II      can  fail  on  a  given  trial  only  if  both    II      and   I  do  not 
fail.      More  precisely,    assume  that 

P  [  I   fails  ]     =    qQ 

P  [  II      fails  j  no    I   failure  ]     -     q 

P  T  II„    fails  I   no    I  failure  h.  no    II.     failure]     -     q 
u      Z  '  1  c 

P  T  IL,    fails  I   I  or    II,    fails]     =    P  [  II.    fails  I  I  fails]     =     0 
2  '  1  i 

Under  these    "exclusive  occurrence"    assumptions,    the  one-step 
transition  matrix  is  of  the  form 
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o 


(1) 


(i) 

'oi 


(1) 


(  I 

'02 


(1) 
*22 


(1) 
'03 


(1) 
'13 


(1) 
'23 


(15) 


where 


(1) 
'00 


(1) 
'01 


q0  +     n    (i  -  q  ) 


(i  -  q0)  qx 


(i) 

'02 


q2d-q0)    (1    -qi 


(1) 
'03 

(1) 
'll 


q0    +     (l-qQ)    d-q2) 


(1) 
(13 


(1    "q0)    q2 


(1) 
'22 


q0    +     d-q0)    (1-V 


(1) 
'23 


d-q0)    q2 


Note:     This  process  can  be  viewed  as  a  wa.lk  on  the  plane  or  as  a  network, 
as  is  suggested  in  Figure  3. 
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FIGURE  3 


Next,    consider  the  case  in  which  the  type  II  modes  are  independent. 


Let 


P  [  I   fails  ]     =     q 


P  [  II      fails  I  no    I   failure]     -     q 


P  [  II      fails  I  no    I   failure  ]     =     q. 


P  [II      fails  &    II      fails  I  no    1   failure]     =     q      q 


assuming  neither  type  II  mode  is  repaired,      In  this  case,    the  matrix 

(1) 
(p.;      )    is  of  the  form  given  in   (15)  ,    with  entries  as  before  except 

that 
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'01 


=     (1    -qQ)    (1    -q2)    qx 


(1) 
'03 


(1 


V    qi    q2 


(The  fact  that    p  is  no  longer  zero  allows  passage  along  the  dotted 

paths  of  Figure  3.  )     Also,    note  that  in  this  case  the  vector    P    of   (14) 
is  given  by 


(1    -  qx)    (1    -  q2) 


(1    -q2) 


(1    -  qx) 


In  both  of  these  examples  and,    in  general  for  other  values  of   k, 
the  computation  of    (p..     )    in  Model  III  can  be  accomplished  using  the 
generating  function  approach  or  the  spectral  decomposition  approach. 
The  probability  generating  function  method  no  longer  applies,    however, 
because  of  the  form  of  the  vector   P  . 
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5.       Summary 

In  viewing  reliability  growth  prediction  models  as  Markov  chains, 
it  is  seen  that  the  computation  of  the  reliability  after    n  trials  and 
possible  associated  repairs,     R      ,    may  be  accomplished  with  any  of 
several  different  methods.      A  class  of  models  is  considered  which 
accommodates  variations  in  several  important  factors  such  as  the 
interdependencies  of  assignable  cause  failure  modes,    inclusion  of  an 
inherent  failure  mode,    the  repair  policy,    and  the  distribution  of  initial 
states  of  the  system. 
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